Equation of state in a small system: Violation of an assumption of Maxwell's demon 
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An equation of state for an ideal gas with a small number of particles is studied. The resulting 
equation is found to differ from that expected in conventional thermodynamics, which is strikingly 
illustrated when considering the traditional thermodynamic problem of Maxwell's demon. We clarify 
the mechanism of this different feature of thermodynamics arising in small systems. 



The thought experiment by Maxwell [l| known as 
Maxwell's demon has attracted the attention of physi- 
cists for more than a century Maxwell's demon is a 
well-known paradox based on the fundamentals of ther- 
modynamics, which seemingly permits a violation of the 
second law of thermodynamics. In the original thought 
experiment, we are asked to imagine a demon that con- 
trols a gate between two compartments. Being able to de- 
termine the speed of the particles in each compartment, 
the demon opens the gate in such a way as to collect more 
high-speed particles in one compartment, thus decreas- 
ing the entropy of the system, in seeming violation of the 
second law. About half a century after Maxwell, Szilard 
extended Maxwell's demon, devising a model which al- 
lowed quantitative description on the extracted workQ. 

The framework of Szilard's formulation is depicted in 
Fig.l. One thermal molecule is in an isothermal system 
and the cycle of Maxwell's demon is considered to be 
composed of two processes: 1) measurement (observa- 
tion) of the molecule position and 2) isothermal expan- 
sion in the process from State B to C. By measurement, 
the demon determines whether the molecule is on the left 
or right side and inserts a wall to create a piston, which is 
accompanied by a mechanical load (weight) for extraction 
of work. In this way, work of an amount W — k^T In 2 
can be extracted from the system by isothermal expan- 
sion. Through cyclic operation, i.e. following the pro- 
cess from States A — > B — > C — > A, work is perpetually 
extracted out of the isothermal system. The operation 
transfers ambient thermal energy into work through the 
isothermal expansion of the "piston" , resulting in a de- 
crease in entropy, fee In 2. In order to save the second 
law, Szilard described how the entropy decrease would be 
compensated "... if the execution of such a measurement 
were, for instance, always accompanied by production of 
k In 2 units of entropy" [3| . 

As has recently been pointed out [J], Szilard did not 
prove his compensation theory, but assumed that his 
heat engine would always preserve the second law. Most 
studies of Maxwell's demon have followed the theoret- 
ical framework of SzilardQ, and have focused on the 
energy cost of observation [f|. In such studies, it is 
generally assumed that, for ideal gases, one can extract 
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FIG. 1: Conventional scheme of Maxwell's demon, after Szi- 
lard (1929) 



work, W, even for a one-molecule isothermal piston, of 
an amount given by the relation W — fy 1 P(V)dV — 
nRT\n{Vf /Vi), where P is the pressure, n is the num- 
ber of molecules in a mole, R is the gas constant, T is 
the temperature, and Vi, and V/ are the initial and final 
volumes of the piston, respectively @. Thus, the conven- 
tional equation of state for an ideal gas has been implic- 
itly assumed: PV = nRT . In other words, studies of 
Maxwell's demon have generally been performed within 
the framework of conventional macroscopic thermody- 
namics, regardless of the small number of molecules 0]. 

On the other hand, recent experimental developments 
have enabled experimental observation of even a single 
molecule in some situations. In molecular motors fclli^fioj 
the value of the work extracted in an elementary process 
fluctuates over repeated experiments, which is in contrast 
to the thought experiment of Maxwell's demon. This 
suggests that there may be an essential fault in the basic 
assumption of Maxwell's demon on this scale, because an 
essential experimentally observed feature of a small-scale 
system, thermal fluctuation, has not been properly ac- 
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FIG. 2: One-dimensional system composed of thermal parti- 
cles and a movable piston. The force of a constant load, /, on 
the movable piston competes with the "pressure" of thermal 
particles. 



counted for. In addition, recent studies that describe the 
energetics in thermally fluctuating systems have shown 
that there is another way of describing the thermody- 
namics of small systems kinetically without employing 
entropy ll| . From this background, a question was re- 
cently raised by Hatano and Sasa[l3| as to the validity of 
the assumption of the work extracted in Szilard's model. 
The study was an attempt at quantitative estimation of 
the work extracted in an operational manner, which is in 
contrast to conventional thought experiments. Although 
their study was a pioneering one, the model resulted in 
broken detailed balance even in the equilibrium state. 

In this paper, we analyze the equation of state in an 
extremely small system, within the boundary of kinet- 
ics. We discuss an equilibrium process here; however, an 
interesting aspect of relaxation into equilibrium is dis- 
cussed by Crosignani and Porto We show that the 
equation of state that Szilard and others have assumed 
for isothermal expansion is not appropriate. We clarify 
the theoretical origin of the difference between an ex- 
tremely small system and conventional macroscopic sys- 
tems towards the construction of a system of thermody- 
namics for small systems 0- 

We begin with an estimation of the equation of state 
of one molecule because typical features of small systems 
are expected at this limit. In order to derive the equa- 
tion, we must confine ourselves to a concrete model that 
permits us to treat the system only within the framework 
of kinetics. As in the study by Hatano and Sasafllj], we 
consider a one-dimensional piston in thermal equilibrium 
(Fig. 2), where the dynamical variables are N "thermal 
particles" and a movable piston on one side. By replacing 
the volume V by the distance between the wall and the 
movable piston X, n by N/n a , and R by ria^B, we obtain 
the equation of state for the system, PX = NksT, where 
n a and fee are the Avogadro constant and the Boltzmann 
constant, respectively. 



Hatano and Sasa claimed that for ideal gases the equa- 
tion of state depends on the masses of the thermal parti- 
cles and the piston and that the conventional equation of 
state is valid if the ratio of the mass of the piston to that 
of the particle is sufficiently large. However, we found, 
by the method of stochastic energetics ll|, that in the 



study by Hatano and Sasa, there is a finite current be- 
tween two thermal baths, one of which is in contact with 
a thermal wall and the other of which is in contact with 
a movable piston, resulting in the broken detailed bal- 
ance. We can learn from this that we cannot naively uti- 
lize a "hybrid" model, for example, Langevin dynamics 
(for a piston) and Hamiltonian dynamics (for a thermal 
particle) simultaneously, because Langevin dynamics is a 
coarse-grained description of Hamiltonian dynamics [l5j|. 
In order to maintain self-consistency in a class of descrip- 
tion, we should return to the framework of elementary 
mechanics. 

In most literature on Maxwell's demon, it is assumed 
that we can fix a movable piston by applying an exter- 
nal force of the same value as the conventional (internal) 
pressure. This assumption fails in a small system, as dis- 
cussed later. Thus, we replace the coarse-grained quan- 
tity "pressure" P by the mechanical force / externally 
exerted on the piston. This yields a reference equation, 
fX = NksT, which we will use to discuss the validity of 
the conventional equation of state, and hence the validity 
of the frameworks of the previous studies. We assume 
that collisions between the variables (particle(s) and a 
piston) are perfectly elastic and that the movable pis- 
ton is frictionless, since "friction" is also a coarse-grained 
quantity which must be excluded for consistency. Then, 
the total energy of the system of one thermal particle 
(N = 1) is written as 



E 



2m 2M 



(1) 



where m(p t ) and M(p p ) are the masses (momenta) of the 
thermal particle and the piston, respectively, and / is a 
force applied to the movable piston. To keep the system 
isothermal, a thermal wall[16[ is introduced. The parti- 
cle is reflected with a positive random velocity according 
to Maxwell's velocity distribution at the boundary of the 
system, x — 0, where x is the position of a thermal par- 
ticle. The thermal wall realizes thermal equilibrium of 
the system. Because the system is one-dimensional, the 
thermal particle is always lower than the piston, x < X. 

One naively expects that the equation of state for 
one molecule should be obtained by replacing N by 1 
in the reference equation fX = Nk-gT; namely fX = 
k^T . The extension of conventional thermodynamics 
into those of one molecule has been performed since 
Szilard 3. In the following, we will investigate the va- 
lidity of this extension in order to uncover the nature 
of thermodynamics for a few molecules. Three methods 
of analyses are performed independently: 1) numerical 
simulation, 2) Master equation analysis, and 3) Gibbs' 
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statistical mechanics. 

In the simulation, the system obeys Hamiltonian dy- 
namics with the exception of the thermal wall, in which 
the thermal particle is reflected with a random velocity 
within the velocity distribution ^\A e -mv 2 /2k B T ^ > ) 
when the particle arrives at the boundary x = 0. The 
condition of the thermal wall is known to direct the tar- 
get system into thermal equilibrium [16j. The numerical 
simulation revealed that the equation of state for one 
molecule is in fact 



/(A) = 2k B T, 



(2) 



where the angular brackets indicate an average value. 
This result is obviously different from that which is con- 
ventionally assumed. 

We obtained the same analytical result using the Mas- 
ter equation of the distribution function in a phase space, 
which consists of Liouville terms and collision terms. Let 
p(x, v, A, v p ) be the probability density of the particles 
(a thermal particle and a movable piston), and v and v p 
the velocities of the thermal particle and movable piston, 
respectively. Here we use velocities instead of momenta 
for simplicity. The density function obeys the following 
equation: 

dp(x, v, X, v p ) 
dt = 

dx p dX M dv p 
-6(v - v p )(v - Vp)p(x,v,X,v p )S(x - X) 
+6(v p — v)(v p — v) 

, m- M 2M 2m M - m . 

X P{ X , v + — Vp.X, — V + — Vp) 

Hy M + m M + m p ' 'M + m M + m PJ 
8{x-X). (3) 

The first three terms of the R.H.S. of this equation 
come from the Liouville equation and the last two terms 
come from collision effects. A stochastic boundary con- 
dition is applied to the system at one end, that is, 
p{x = +Q,v) = ^-^Lexp[-mv 2 /2T] for v > 0. The 
stochastic condition corresponds to the thermal wall in 
the numerical simulation. From straightforward calcula- 
tion, one obtains a stationary solution, p(x,pt, X, p p ) — 



r 1 



- exp{- 



P i/2m+ P 2 /2M+fX 

2n(k B T) WmM L 1 k B T >s u y A zj, wnere 

9 is a Heaviside step function. From this equation, we 
again obtain Eq. @ . Note that the result is independent 
of the masses of both the thermal particle and the mov- 
able piston, which is in contrast to the result by Hatano- 
Sasa [jj]. 

Although we introduced a thermal wall and, corre- 
spondingly a stochastic boundary condition, one may 
obtain the same generalized result without applying 
such boundary conditions, but instead using conventional 
Gibbs' statistical mechanics. Since the present system 
has two constant parameters, temperature and force (ap- 
plied to the piston), the system can be described by a 



pressure ensemble (P-T ensemble) of Gibb's statistical 
mechanics (l7j. The quantity "pressure" in a conventional 
pressure ensemble is replaced here by a force. This re- 
placement does not alter any general result of the pres- 
sure ensemble, because one can reprove any derivation 
in the pressure ensemble with this replacement. The 
Laplace transformation between a partition function of 
the canonical ensemble Z and that of the pressure en- 
semble Y is given as Y = J™ dV exp [-PV/(k B T)}Z^, 
from which we obtain the partition function of the 
pressure ensemble of the system of N particles, Y = 
F(—^) N+1 , where F is a factor that will drop out later. 
The average position of the movable piston is obtained 
as (X) = --^^f = (N + l)k B T/f. Thus, we have 
f(X) = (N+\)k B T. The previous result, f(X) = 2k B T, 
is again obtained by replacing TV by 1. One finds that in a 
sufficiently large system, N 3> 1 (thermodynamic limit), 
N + 1 may be replaced by N . However, in the small sys- 
tem, the difference between N + 1 and N is crucial, as 
shown in Fig. [3] 

This result is apparently in contrast to the basic as- 
sumption made by Szilard and others, in which the 
macroscopic thermodynamic relation is assumed to hold 
even in a small system, namely, fX = k B T for one 
molecule. In such studies, we find that it has been as- 
sumed that one can "fix" or quasi-statistically "control" 
the position of the piston, where the existence of the 
working bath (or "working reservoir" ) (Ijj behind the pis- 
ton is implicitly assumed. However, for a small system, 
the question as to how one can fix or control the piston in 
an operational or experimental manner should be care- 
fully examined [l9(| . The validity of the concept of the 
working bath is not evident in small systems [111]. If one 
fixes the position of the piston, that is, if one eliminates 
the variability of the piston, work cannot be extracted out 
of the system because the "fixed" piston cannot transfer 
thermal energy into work. Such a framework is in con- 
tradiction to, and thus is no longer physically valid in, 
studies of Maxwell's demon. This is precisely the rea- 
son why we introduced an external load to the piston 
instead of using the concepts of "pressure" or a "working 
bath" . It should also be noted that the movable piston 
satisfies the thermal property (Maxwell's velocity distri- 
bution) merely through kinetic collision with a thermal 
particle. The evidence supports the physical consistency 
of the present description. 

In the following paragraphs, we will present the role 
of thermal fluctuation as it essentially relates to the 
equation of state 12[ . We have the distribution func- 
tion in phase space, p = F'e~f x l kj>T 6{X — xn)6(xn — 
xjv-i) ■ • • 0(x2 — %i), where F' and factor and the 

position of the z-th thermal particle (X > xn > • ■ • > 
%2 > x\), respectively. By integrating all the spatial co- 
ordinates, except for that of the movable piston, A, we 
obtain the distribution function of the movable piston: 

rv\ 1 ( k vT N+1 fX - Nk B TlnX 

p(X) = M ( — ) exp{ fer } ' (4) 
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FIG. 3: The dependence of the number of particles, N, on the 
time average of the position of the piston, where fee = T = 
/ = 1 for simplicity. For comparison, the average position is 
normalized by N. If the reference equation of state, fX = 
Nk-aT, were valid for any N, {X)/N would remain as 1. 
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FIG. 4: Distribution function of the position of the movable 
piston, where ks = T = f = 1 and the horizontal axis is 
normalized by N for simplicity. As the number of parti- 
cles decreases, the deviation from the most probable position, 
X*/N — 1, becomes substantial. For comparison, the posi- 
tion is normalized by the number of thermal particles, N. 



Now, we define the coordinate X = X* where the dis- 
tribution function p{X) is maximum. From Eq. we 
get the relation X* — Nk^T/ f. Thus, the conventional 
thermodynamic relation fX = Nk^T still remains for 
the most probable position of the piston, X* , although 
it does not hold for the average position. The reason 
why the average position of the piston deviates from the 
most probable position, X* , is that thermal fluctuation 
of the piston i s substantial f or small systems, as seen by 
the relation y/((X - (X)) 2 )/(X) = 1/yfW+l. Figure 4 
shows the distribution function of the movable piston for 
three different quantities of thermal particles (N = 1, 
10, and 100), where the horizontal axis is normalized 
by N. As the number of particles decreases, the fluc- 
tuation from the most probable position, X = X* , and 
simultaneously the asymmetry of the distribution func- 



tion, increase, while the most probable position of the 
piston continues to obey the conventional equation of 
state. Thus, the average equation of state deviates from 
the conventional one as the number of particles decreases. 
An interesting question relevant to any technique that re- 
duces the thermal fluctuation of one molecule, as applied 
in probe microscopy [20], may arise here: Which position 
does the frozen position of a molecule correspond to, the 
most probable position or the average position obtained 
before the reduction in thermal fluctuation? 

We can learn here the features of the concept of a " 
quasi-static process" in extremely small systems. Szilard 
and others implicitly assumed that the expansion process 
could be described in the same quasi-static framework as 
its macroscopic counterpart. However, the condition of a 
quasi-static process requires a completely different frame- 
work at the microscopic level from that at the macro- 
scopic level[19]. A quasi-static condition always requires 
that a system should itinerate all the possible phase space 
sufficiently under the current parameters of the system. 
For this requirement, the system parameters should vary 
slowly enough during a quasi-static thermodynamic pro- 
cess. In our case, what should vary slowly is not the 
position of the piston but the force, /. In the expansion 
process, the piston moves rapidly following a slow change 
in the force. Thus, the conventional picture of a gradu- 
ally expanding piston does not correspond to quasi-static 
expansion in small systems. Szilard and others had not 
anticipated this fact. 

In this paper, we showed in the framework of Szilard's 
model that the equation of state for a few molecules is dif- 
ferent from that previously assumed by Szilard and oth- 
ers. In the thermodynamic limit, the equation of state 
is found to coincide with the conventional equation of 
state[2l|. The result reveals that the macroscopic frame- 
work of thermodynamics has been incorrectly extended 
into the one molecule world, which has been assumed in 
the literature of Maxwell's demon. 

This counterexample to the basic assumption of 
Maxwell's demon brings to light the need to develop the 
thermodynamics of small systems [llj]. This is important 
not only for Maxwell's demon but also for proper inter- 
pretation and modeling of one-molecule experiments, in 
which the experimental data vary among observations. 
One-molecule thermodynamics is not a rescaled version of 
its macroscopic counterpart [22I] . Filling the gap between 
one-molecule thermodynamics and macroscopic thermo- 
dynamics should be an interesting challenge from both 
philosophical and practical viewpoints of physics. 
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